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5 CROSS REFERENCE TO RELATED APPLICATION 

This application claims the benefit of Provisional Patent Application 
No. 60/190,371, which application is herein incorporated by reference. 



BACKGROUND OF THE INVENTION 

10 The present invention relates to vector quantization (VQ) in speech 

coding systems using waveform interpolation. 

In recent years, there has been increasing interest in achieving toll- 
quality speech coding at rates of 4 kbps and below. Currently, there is an 
ongoing 4 kbps standardization effort conducted by an international 

15 standards body (The International Telecommunications Union- 
Telecommunication (ITU-T) Standardization Sector). The expanding 
variety of emerging applications for speech coding, such as third 
generation wireless networks and Low Earth Orbit (LEO) systems, is 
motivating increased research efforts. The speech quality produced by 

20 waveform coders such as code-excited linear prediction (GELP) coders 
degrades rapidly at rates below 5 kbps; see B. S. Atal, and M. R. 
Schroeder, (1984) "Stochastic Coding of Speech at Very Low Bit Rate", 
Proc. Int. Conf. Comm, Amsterdam, pp. 1610-1613. 
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On the other hand, parametric coders, such as: the waveform- 
interpolative (Wl) coder, the sinusoidal-transform coder (SJC), and the 
multiband-excitation (MBE) coder, produce good quality at low rates but 
they do not achieve toll quality; see Y. Shoham, IEEE ICASSP'93, Vol. II, 
5 pp. 167-170 (1993); I. S. Burnett, and R. J. Holbeche, (1993), IEEE 

ICASSP'93, Vol. II, pp. 175-178; W. B. Kleijn, (1993), IEEE Trans. Speech 
and Audio Processing, Vol. 1, No. 4, pp. 386-399; W. B. Kleijn, and J. 
Haagen, (1994), IEEE Signal Processing Letters, Vol. 1, No. 9, pp. 136- 
138; W. B. Kleijn, and J. Haagen, (1995), IEEE ICASSP'95, pp. 508-511; 
10 W. B. Kleijn, and J. Haagen, (1995), in Speech Coding Synthesis by W. B. 
Kleijn and K. K. Paliwal, Elsevier Science B. V., Chapter 5, pp. 175-207; I. 
S. Burnett, and G. J. Bradley, (1995), IEEE ICASSP'95, pp. 261-263, 
1995; I. S. Burnett, and G. J. Bradley, (1995), IEEE Workshop on Speech 
Coding for Telecommunications, pp. 23-24; I. S. Burnett, and D. H. Pham, 
15 (1997), IEEE ICASSP'97, pp. 1567-1570; W. B. Kleijn, Y. Shoham, D. Sen, 
and R. Haagen, (1996), IEEE ICASSP'96, pp. 212-215; Y. Shoham, 
(1997), IEEE ICASSP'97, pp. 1599-1602; Y. Shoham, (1999), International 
Journal of Speech Technology, Kluwer Academic Publishers, pp. 329-341; 
R. J. McAulay, and T. F. Quatieri, (1995),/n Speech Coding Synthesis by 
20 W. B. Kleijn and K. K. Paliwal, Elsevier Science B. V., Chapter 4, pp. 121- 
173; and D. Griffin, and J. S. Lim, (1988), IEEE Trans. ASSP, Vol. 36, No. 
8, pp. 1223-1235. This is largely due to the lack of robustness of speech 
parameter estimation, which is commonly done in open-loop, and to 
inadequate modeling of non-stationary speech segments. 
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Commonly in Wl coding, the similarity between successive rapidly 
evolving waveform (REW) magnitudes is exploited by downsampling and 
interpolation and by constrained bit allocation; see W. B. Kleijn, and J. 
Haagen, (1995), IEEE ICASSP'95, pp. 508-511. In a previous Enhanced 

5 Waveform Interpolative (EWI) coder the REW magnitude was quantized 
on a waveform by waveform base; see O. Gottesman and A. Gersho, 
{1999),"Enhanced Waveform Interpolative Coding at4 kbps", IEEE 
Speech Coding Workshop, pp. 90-92, Finland; Finland.©. Gottesman and 
A. Gersho, (1999),"Enhanced Analysis-by-Synthesis Waveform 

10 Interpolative Coding at 4 kbps", EUROSPEECH'99, pp. 1443-1446, 
Hungary. 

SUMMARY OF THE INVENTION 

The present invention describes novel methods that enhance the 

15 performance of the Wl coder, and allows for better coding efficiency 
improving on the above 1999 Gottesman and Gersho procedure. The 
present invention incorporates analysis-by-synthesis (AbS) for parameter 
estimation, offers higher temporal and spectral resolution for the REW, 
and more efficient quantization of the slowly-evolving waveform (SEW). In 

20 particular, the present invention proposes a novel efficient parametric 
representation of the REW magnitude, an efficient paradigm for AbS 
predictive VQ of the REW parameter sequence, and dual-predictive AbS 
quantization of the SEW. 
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More particularly, the invention provides a method for interpolative 
coding input signals, the signals decomposed into or composed of a slowly 
evolving waveform and a rapidly evolving waveform having a magnitude, 
the method incorporating at least one various, preferably combinations of 
the following steps or can include all of the steps: 

(a) AbSVQofthe REW; 

(b) parametrizing the magnitude of the REW; 

(c) incorporating temporal weighting in the AbS VQ of the REW; 

(d) incorporating spectral weighting in the AbS VQ of the REW; 

(e) applying a filter to a vector quantizer codebook in the 
analysis-by-synthesis vector-quantization of the rapidly evolving waveform 
whereby to add self correlation to the codebook vectors; and 

(f) using a coder in which a plurality of bits therein are allocated 
to the rapidly evolving waveform magnitude. 

In addition, one can combine AbS quantization of the slowly 
evolving waveform with any or all of the foregoing parameters. 

The new method achieves a substantial reduction in the REW bit 
rate and the EWI achieves very close to toll quality, at least under clean 
speech conditions. These and other features, aspects, and advantages of 
the present invention will become better understood with regard to the 
following detailed description, appended claims, and accompanying 
drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a REW Parametric Representation; 
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Figure 2 is a REW Parametric VQ; 
Figure 3 is a REW Parametric Representation AbS VQ; 
Figure 4 is a REW Parametric Representation Simplified AbS VQ; 
Figure 5 is a REW Parametric Representation Simplified Weighted AbS 
5 VQ; 

Figure 6 is a block diagram of the Dual Predictive AbS SEW vector 
quantization; 

Figure 7 is a weighted Signal-to-Noise Ratio (SNR) for Dual Predictive 
AbS SEWVQ; 

10 Figure 8 is an output Weighted SNR for the 1 8 codebooks, 9-bit AbS SEW 
VQ; 

Figure 9 is a mean-removed SEW's Weighted SNR for the 18 codebooks, 
9-bit AbS SEWVQ; and 

Figure 10 are predictors for three REW parameter ranges. 

15 

DETAILED DESCRIPTION 

in very low bit rate Wl coding, the relation between the SEW and 
the REW magnitudes was exploited by computing the magnitude of one as 
the unity complement of the other; see W. B. Kleijn, and J. Haagen, 
20 (1995), "A Speech Coder Based on Decomposition of Characteristic 

Waveforms", IEEE ICASSP'95, pp. 508-511; W. B. Kleijn, and J. Haagen, 
(1995), "Waveform Interpolation for Coding and Synthesis", in Speech 
Coding Synthesis by W. B. Kleijn and K. K. Paliwal, Elsevier Science B. V., 
Chapter 5, pp. 175-207; I. S. Burnett, and G. J. Bradley, (1995), "New 
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Techniques for Multi-Prototype Waveform Coding at 2.84 kb/s", IEEE 
ICASSP'95, pp. 261-263, 1995; I. S. Burnett, and G. J. Bradley, (1995), 
"Low Complexity Decomposition and Coding of Prototype Waveforms", 
IEEE Workshop on Speech Coding for Telecommunications, pp. 23-24; I. 
S. Burnett, and D. H. Pham, (1997), "Multi-Prototype Waveform Coding 
using Frame-by-Frame Analysis-by-Synthesis", IEEE ICASSP'97, pp. 
1567-1570; W. B. Kleijn, Y. Shoham, D. Sen, and R. Haagen, (1996), "A 
Low-Complexity Waveform Interpolation Coder", IEEE ICASSP'96, pp. 
212-215; Y. Shoham, (1997), "Very Low Complexity Interpolative Speech 
Coding at 1.2 to 2.4 kbps", IEEE ICASSP'97, pp. 1599-1602; Y. Shoham, 
(1999), "Low-Complexity Speech Coding at 1 .2 to 2.4 kbps Based on 
Waveform Interpolation", International Journal of Speech Technology, 
Kluwer Academic Publishers, pp. 329-341. 

Also, since the sequence of SEW magnitude evolves slowly, 
successive SEWs exhibit similarity, offering opportunities for redundancy 
removal. Additional forms of redundancy that may be exploited for coding 
efficiency are: (a) for a fixed SEW/REW decomposition filter, the mean 
SEW magnitude increases with the pitch period and (b) the similarity 
between successive SEWs, also increases with the pitch period. In this 
work we introduce a novel "dual-predictive" AbS paradigm for quantizing 
the SEW magnitude that optimally exploits the information about the 
current quantized REW, the past quantized SEW, and the pitch, in order to 
predict the current SEW. 
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Introduction to REW Quantization 

The REW represents the rapidly changing unvoiced attribute of 
speech. Commonly in Wl systems, the REW is quantized on a waveform 
by waveform base. Hence, for low rate Wl systems having long frame size, 
5 and a large number of waveforms per frame, the relative bitrate required 
for the REW becomes significantly excessive. For example, consider a 
potential 2 kbps system which uses a 240 sample frame, 12 waveforms 
per frame, and which quantizes the SEW by alternating bit allocation of 3 
bit and 1 bit per waveform. The REW bitrate is then 24 bit per frame, or 

10 800 kbps which is 40% of the total bitrate. This example demonstrates the 
need for a more efficient REW quantization. 

Efficient REW quantization can benefit from two observations: (1) 
the REW magnitude is typically an increasing function of the frequency, 
which suggests that an efficient parametric representation may be used; 

15 (2) one can observe a similarity between successive REW magnitude 
spectra, which may suggest a potential gain by employing predictive VQ 
on a group of adjacent REWs. The next two sections propose REW 
parametric representation, and its respective VQ. 

20 REW Parametric Representation 

Direct quantization of the REW magnitude is a variable dimension 
quantization problem, which may result in spending bits and computational 
effort on perceptually irrelevant information. A simple and practical way to 
obtain a reduced, and fixed, dimension representation of the REW is with 
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a linear combination of basis functions, such as orthonormal polynomials; 
see W. B. Kleijn, Y. Shoham, D. Sen, and R. Haagen, (1996), IEEE 
ICASSP'96, pp. 212-215; Y. Shoham, (1997), IEEE ICASSP'97, pp. 1599- 
1602; Y. Shoham, (1999), International Journal of Speech Technology, 
5 Kluwer Academic Publishers, pp. 329-341. Such a representation usually 
produces a smoother REW magnitude, and improves the perceptual 
quality. Suppose the REW magnitude, R{(o), is represented by a linear 
combination of orthonormal functions, ^(»): 

R(co)--Y,^,i//,((^) , 0<o)<n: (1) 

!=0 

10 where co is the angular frequency, and / is the representation order. The 
REW magnitude is typically an increasing function of frequency, which, 
can be coarsely quantized with a low number of bits per waveform without 
significant perceptual degradation. Therefore, it may be advantageous to 
represent the REW magnitude in a simple, but perceptually relevant 

15 manner. Consequently we model the REW by the following parametric 
representation, Rico, 4): 

R(co,^) = Y,fX^)¥X(o) , (i<co<7t ;0<^<1 (2) 

1=0 

where y(^) = fi-i(4)] ^ 's a parametric vector of coefficients within 

20 the representation model subspace, and 4 is the "unvoicing" parameter 
which is zero for a fully voiced spectrum, and one for a fully unvoiced 
spectrum. Thus R(a),4) defines a two-dimensional surface whose cross 
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sections for each value of #give a particular REW magnitude spectrum, 
which is defined merely by specifying a scalar parameter value. 

A stmpie and practical way for parametric representation of the 
REW is, for example, by a parametric linear combination of basis 
5 functions, such as polynomials with parametric coefficients, namely: 

R(o),<^) = YjfX^)(o' , 0<co<7V ; 0<^<1 (3) 

1=0 

For practical considerations assume that the parametric representation is 
10 a piecewise linear function of ^, and may therefore be represented by a set 
of N uniformly spaced spectra, as illustrated in FIGURE 1. 

REW Parametric Vector Quantization 

One can observe the similarity between successive REW 
15 magnitude spectra, which may suggest a potential gain by VQ of a set of 
successive REWs. Figure 2 illustrates a simple parametric VQ system for 
a vector of REW spectra. The input is an M dimensional vector of REW 
magnitude spectra, 

20 Rio))=[R,(o)),R^iQ)),...,R^((D)f (4) 

and the VQ output is an index, / which determines a quantized parameter 
vector, I : 
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(5) 



which parametrically determines a vector of quantized spectra: 



The encoder searches, in the parameter codebook Cq{^), for the 
parameter vector which minimizes the distortion: 



10 i = argmin{f;£>(7?^,^(^„))l = argmm\f^\R^(ca)-R(o},uf dco (7) 



For example, suppose the input REW magnitude is represented by an l-th 
dimensional vector of function coefficients, y, given by: 



15 y = \ro>n,-,r}-yV W 



For a set of M input REWs, each is of which represented by a vector of 
polynomial coefficients, , which form a PxM input coefficient matrix, r: 



20 r = [yj,y2,...,Y^] (9) 
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The inverse VQ output is a vector of M quantized REWs, which form the 
quantized function coefficient matrix: 



5 which is used by the decoder to compute the quantized spectra. 
A. Quantization Using Orthonormal Functions 
Orthonormal functions, such as polynomials, may be used for 
efficient quantization of the REW; see W. B. Kleijn, et a!., (1996), IEEE 
ICASSP'96, pp. 212-215; Y. Shoham, (1997), \EEE ICASSP'97, pp. 1599- 
10 1602; Y. Shoham, (1999), IntemationalJoumal of Speech Technology, 
Kluwer Academic Publishers, pp. 329-341 . Consider REW magnitude, 
R{(o), represented by a linear combination of orthonormal functions, i//i{coy. 

i-i 

R(co) ^J^r,y/X(>^) , 0<a><^ (11) 



r(l) = [Y(li),Y(4)v..,T(4)] 



(10) 



15 



which is modeled using the parametric representation: 



0<co<n: 



0<^<1 



(12) 



20 The quantized REW parameter is then given by: 




(13) 
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In VQ case, the quantized parameter vector is given by: 

I = argmiiijf;Z)(i?„ = argminjf;||7„ -T(^j|r| (14) 

5 

B. Piecewise Linear Parametric Representation 
In order to have a simple representation that is computationally 
efficient and avoids excessive memory requirements, we model the two 
dimensional surface by a piecewise linear parametric representation. 
10 Therefore, we introduce a set of N uniformly spaced spectra, {R(co,i„)}^~l . 
Then the parametric surface is defined by linear interpolation according t: 

R(o}, ^) = (1 - a)R(6), 4_, ) + aR(Q), |j (15) 

15 

Because this representation is linear, the coefficients of R{ca,^) are linear 
combinations of the coefficients of R{(a,i„_i) and R(o),i„). Hence, 

T(^) = (l-cr)y„_i+«y„ (16) 

20 

where y„ is the coefficient vector of the A?-th REW magnitude function 
representation: 
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(17) 



In this case, the distortion may be interpolated by: 




(18) 



The above can be easily generalized to the parameter VQ case. The 
optimal interpolation factor that minimizes the distortion between two 
representation vectors is given by: 



and the respective optimal parameter value, which is a continuous variable 
between zero and one, is given by: 



This result allows a rapid search for the best unvoicing parameter value 
needed to transform the coefficient vector to a scalar parameter, followed 
by the corresponding quantization scheme, as described in the section 4. 

C. Weighted Distortion Quantization 
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Commonly in speech coding, the magnitude Is quantized using 
weighted distortion measure. In this case the quantized REW parameter 
is then given by: 

5 E,- argmin \ - Rico, ^)| W{(D)d(o \ (21 ) 

and the orthonormal function simplification, given in equation (13), cannot 
be used. In this case, the weighted distortion between the input and the 
parametric representation modeled spectra is equal to: 

10 

(r, R(^)) = ]|i?(^») - R(o?, W(co)dcD = (y - mJ ^(f^(^)X7 - T(^)) (22) 

0 

where W(W(o))) is the weighted correlation matrix of the orthonormal 
functions, its elements are: 

15 

T, ^ {W(a))) = lW(cD)y/, {G})\(f ^ (o})dco , (23) 

y is the input coefficient vectors, and y(^) is the modeled parametric 
coefficient vector. In VQ case, the quantized parameter vector is given by: 

20 
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^24; 

D. Weighted Distortion - Piecewise Linear Parametric 
5 Representation 

Again, for practical considerations assume that the parametric 
representation is piecewise linear, and may be represented by a set of N 
spectra, {r(cl>,^„)}^~1 . For the piecewise linear representation, the 
interpolated quantized coefficient vector is: 

10 

T(^) = (l-a)Y„.,+ay„ ; L,<^<1 ; (25) 

In the case where parameter VQ is employed, the interpolation allows for a 
substantial simplification of the search computations. In this case, the 
15 distortion can be interpolated: 

[r, R{^)) = (t - (1 - «)Y„_: -c^J'¥{W(co)Xy - (1 - «)y„-i - «T„ ) 
= Y^^Y + (1 - Y„/^Y„-i + oy/^Y„ - 2(1 - a)Y^^Y„-i - 2o7^Ty„ + 2«(1 - a)Y 

(26) 

20 

Note that no benefit is obtained here by using orthonormal functions, 
therefore any function representation may be used. The above can be 
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easily generalized to the parameter VQ case. The optimal parameter that 
minimizes the spectrally weighted distortion between two representation 
vectors is given by: 



, _ (T„-Y.-if^(T-f„-i) (27) 
(Y„-Y„-i/m-Y„-,) 



and the respective optimal parameter value, which is a continuous variable 
between zero and one, is given by equation (20). This result allows a 
rapid search for the best unvoicing parameter value needed to transform 
10 the coefficient vector to a scalar parameter, for encoding or for VQ design. 
Alternatively, in order to eliminate using the matrix i}/, the scalar product 
may redefined to incorporate the time-varying spectral weighting. The 
respective orthonormal basis functions then satisfy: 



1 5 jwim)y/, (co)y/j ico)dco = d{i - J) (28) 



where d(i - j) denotes Kroneker delta. The respective parameter vector 
is given by: 



20 Y = \w{co)Rico)yvi^)do} (29) 
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where vi/(<2>) = [wo,Wir-^¥i-i \ ^ an l-th dimensional vector of time-varying 
orthonormal functions. 

REW Parameter Anaivsis-Bv-Svnthesis VQ 

5 This section presents the AbS VQ paradigm for the REW 

parameter. The first presentation is a system which quantizes the REW 
parameter by employing spectral based AbS. Then simplified systems, 
which apply AbS to the REW parameter, are presented. 

A. REW Parameter Quantization by Magnitude AbS VQ 

10 The novel Analysis-by-Synthesis (AbS) REW parameter VQ 

technique is illustrated in FIGURE 3. An excitation vector c„(«j) 
(a77= M) is selected from the VQ codebook and is fed through a 
synthesis filter to obtain a parameter vector i(m) (synthesized quantized) 
which is then mapped to quantized a representation coefficient vectors 

15 y(iim)). This is compared with a sequence of input representation 

coefficient vectors j{m) and each is spectrally weighted. Each spectrally 
weighted error is then temporally weighted, and a distortion measure is 
obtained. A search through all candidate excitation vectors determines an 
optimal choice. The synthesis filter in FIGURE 3 can be viewed as a first 

20 order predictor in a feedback loop. (While shown here is an auto- 
regressive synthesis filter, in other arrangements moving-average (MA) 
synthesis filter may be used.) By allowing the value of the predictor 
parameter P to change, it becomes a "switched-predictor" scheme. 
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Switched-prediction is introduced to allow for different levels of REW 
parameter correlation. 

The scheme incorporates both spectral weighting and temporal 
weighting. The spectral weighting is used for the distortion between each 

5 pair of input and the quantized spectra. In order to improve SEW/REW 
mixing, particularly in mixed voiced and unvoiced speech segments, and 
to increase speech crispness, especially for plosives and onsets, temporal 
weighting is incorporated in the AbS REW VQ. The temporal weighting is 
a monotonic function of the temporal gain. Two codebooks are used, and 

10 each codebook has an associated predictor coefficient, Pi and P2. The 
quantization target is an M-dimensional vector of REW spectra. Each 
REW spectrum is represented by a vector of basis function coefficients 
denoted by y(m). The search for the minimal WMSE is performed over all 
the vectors, c,j (m) , of the two codebooks for /= 1 , 2. The quantized REW 

15 function coefficients vector, y{§{m)), is a function of the quantized 
parameter , which is obtained by passing the quantized vector, 
c,j (m) , through the synthesis filter. The weighted distortion between each 
pair of input and quantized REW spectra is calculated. The total distortion 
is a temporally-weighted sum of the M spectrally weighted distortions. 

20 Since the predictor coefficients are known, direct VQ can be used to 
simplify the computations. For a piecewise linear parametric REW 
representation, a substantial simplification of the search computations may 
be obtained by interpolating the distortion between the representation 
spectra set, as explained in sections 3.B. and 3.D. 
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A sequence of quantized parameter, such as c{k) , is formed by 
concatenating successive quantized vectors, such as {c,^ (/w)}^ ^ . The 
quantized parameter is computed recursively by: 



5 iik) - P(k)i(k - 1) + c(k) (30) 

where k is the time index of the coded waveform. 
B. Simplified REW Parameter AbS VQ 
The above scheme maps each quantized parameter to coefficient 
10 vector, which is used to compute the spectral distortion. To reduce 
complexity, such mapping, and spectral distortion computation, which 
contribute to the complexity of the scheme, may be eliminated by using the 
simplified scheme described below. For a high rate, and a smooth 
representation surface R{co,^) , the total distortion is equal to the sum of 
15 modeling distortion and quantization distortion: 

X D„ (Rim), ham))) =YD^ (R(m), ^(^(m)))+ (^(^(m)), i(|(m))) 
(31) 

20 The quantization distortion is related to the quantized parameter by: 



25010134.1 

19 



|; (^(^ (m)), i(|(m)))= X (t(^('")) - Y(I(^))T^('^(^))(7(^(^)) - Y(I('«))) 
(32) 



which, for the piecewise linear representation case, is equal to 

5 

(33) 

which is linearly related to the REW parameter squared quantization error, 
10 (^(m) - |(m))^ and, therefore, justifies direct VQ of the REW parameter. 

B.1. Simplified REW Parameter AbS VQ - Non Weighted 
Distortion 

FIGURE 4 illustrates a simplified AbS VQ for the REW parametric 
15 representation. The encoder maps the REW magnitude to an unvoicing 
REW parameter, and then quantizes the parameter by AbS VQ. Initially, 
the magnitudes of the M REWs in the frame are mapped to coefficient 
vectors, {tC'w)}^^! . Then, for each coefficient vector, a search is performed 
to find the optimal representation parameter, ^y), using equation (20), to 
20 form an M-dimensional parameter vector for the current frame, 

fe(T('«))ff=i ■ Finally, the parameter vector is encoded by AbS VQ. The 
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decoded spectra, {^(ty,|(m))f^i , are obtained from the quantized parameter 

vector, , using equation (15). This scheme allows for higher 

temporal, as well as spectral REW resolution, compared to the common 
method described in W.B. Kleijn, et al, IEEE ICASSP'95, pp.508-511 
5 (1 995), since no downsampling is performed, and the continuous 
parameter is vector quantized in AbS. 

B.2. Simplified REW Parameter AbS VQ -Weighted Distortion 
The simplified quantization scheme is improved to incorporate 
10 spectral and temporal weightings, as illustrated in Figure 5. The REW 
parameter vector is first mapped to REW parameter by minimizing a 
distortion, which is weighted by the coefficient spectral weighting matrix W, 
as described in section 3.D. Then, the resulted REW parameter is used to 
compute a weighting, Ws{<^m)), which we choose to be the spectral 
15 sensitivity to the REW parameter squared quantization error, 
(^(w)-l(m)^, given by: 

20 For the piecewise linear representation case, using equation (33), the 
following equation is obtained: 
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(35) 

The above derivative can be easily computed off line. Additionally, a 
5 temporal weighting, in form of monotonic function of the gain, denoted by 
wtig{m)), is used to give relatively large weight to waveforms with larger 
gain values. The AbS REW parameter quantization is computed by 
minimizing the combined spectrally and temporally weighted distortion: 

10 D({^(m)Zr, \^(m)}tO = w,(g(m))w,(^(/«))(^(m) -ICm))" (36) 

The weighted distortion scheme improves the reconstructed speech 
quality, most notably in mixed voiced and unvoiced speech segments. This 
may be explained by an improvement in REW/SEW mixing. 

15 Dual Predictive AbS SEW Quantization 

Figure 6 illustrates a Dual Predictive SEW AbS VQ scheme which 
uses two observables, (a) the quantized REW, and (b) the past quantized 
SEW, to jointly predict the current SEW. Although we refer to the operator 
on each observable as a "predictor", in fact both are components of a 

20 single optimized estimator. The SEW and the REW are complex random 
vectors, and their sum is a residual vector having elements whose 
magnitudes have a mean value of unity. In low bit-rate Wl coding, the 
relation between the SEW and the REW magnitudes was approximated by 
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computing the magnitude of one as the unity complement of the other. 
Suppose Irwi denotes the spectral magnitude vector of the last quantized 
REW in the current frame. An "implied" SEW vector, is calculated by: 

5 ^M,implied\^'^-\^M\ (37) 

and from which the mean vector is removed. Vectors whose means are 
removed are denoted with an apostrophe. Then, a (mean-removed) 

estimated "implied" SEW magnitude vector, , is computed using a 

10 diagonal estimation matrix p^^. 



(38) 



Additionally, a "self-predicted" SEW vector is computed by multiplying the 
15 delayed quantized SEW vector, |s'o| , by a diagonal prediction matrix p^^,^. 
The predicted (mean-removed) SEW vector, is given by: 

I S M i ~ ^REW 1^ M, implied \ ^SEW |^ 0 1 (39) 

20 The quantized vector, , is determined by an AbS search according to: 
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=argmm{ (|sV|-|sVl-c,)'W^(|sV|-|sV|-c,) } (40) 

where is the diagonal spectral weighting matrix; see O. Gottesman, 
(1999), IEEE ICASSP'99, vol. 1:269-272; O. Gottesman and A. Gersho, 
5 (1999), IEEE Speech Coding Workshop, pp. 90-92, Finland; O. Gottesman 
and A. Gersho,(1999), EUROSPEECH'99, pp. 1443-1446, Hungary. The 
(mean-removed) quantized SEW magnitude, |s'm| , is the sum of the 
predicted SEW vector, |sV|, and the codevector : 

10 |sVh|sV| + CM (41) 

In order to exploit the information about the pitch and voicing level, 
the possible pitch range was partitioned into six subintervals, and the REW 
parameter range into three. Also, eighteen codebooks were generated, 

15 one for each pair of pitch range and unvoicing range. Each codebook has 
associated two mean vectors, and two diagonal prediction matrices. To 
improve the coder robustness and the synthesis smoothness, the cluster 
used for the training of each codebook overlaps with those of the 
codebooks for neighboring ranges. Since each quantized target vector 

20 may have a different value of the removed mean, the quantized mean is 
added temporarily to the filter memory after the state update, and the next 
quantized vector's mean is subtracted from it before filtering is performed. 
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The output weighted SNR, and the mean-removed weighted SNR, 
of the scheme are illustrated in Figure 7. Evidently, a very high SNR is 
achieved with a relatively small number of bits. The weighted SNR of 
each codebook, for the 9-bit case, is Illustrated in Figure 8. The 
5 differences in SNR between three REW parameter ranges is dominated by 
the different means. The respective mean-removed weighted SNR of 
each codebook is illustrated in FIGURE 9. Within each voicing range the 
differences in SNR between each pitch range are mainly due to the 
number of bit per vector sample, which decreases as the number of 

10 harmonics increases, and to the prediction gain. 

Examples for the two predictors for three REW parameter ranges 
are illustrated in Figure 10. For voiced segment the SEW predictor is 
dominant, whereas the REW predictor is less important since its input 
variations in this range are very small. As the voicing decreases, the SEW 

15 predictor decreases, and the REW predictor becomes more dominant at 
the lower part of the spectrum. Both predictors decrease as the voicing 
decreases from the intermediate range to the unvoiced range. 

Bit Allocation 

20 The bit allocation for the 2.8 kbps EWI coder is given in Table 1. 

The frame length is 20 ms, and ten waveforms are extracted per frame. 
The line spectral frequencies (LSFs) are coded using predictive MSVQ, 
having two stages of 10 bit each, a 2-bit increase compared to the past 
version of our code; see O. Gottesman and A. Gersho, (1999), IEEE 
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Speech Coding Workshop, pp. 90-92, Finland; O. Gottesman and A. 
Gersho,(1999), EUROSPEECH'99, pp. 1443-1446, Hungary. The 10-ih 
dimensional log-gain vector is quantized using 9 bit AbS VQ; The pitch Is 
coded twice per frame. A fixed SEW phase was trained for each one of 
5 the eighteen pitch-voicing ranges; see O. Gottesman, (1999), IEEE 
ICASSP'99, vol. 1:269-272. 



Parameter 


Bits / Frame 


Bits / second 


LPC 


20 


1000 


Pitch 


2x6 = 12 


600 


Gain 


9 


450 


SEW magnitude 


8 


400 


REW magnitude 


7 


350 


Total 


56 


2800 



Table 1 

10 Subiective Results 

A subjective A/B test was conducted to compare the 2.8 kbps EWI 
coder of this invention to G.723.1. The test data included 24 modified 
Intermediate reference system (M-IRS) filtered speech sentences, 12 of 
which are of female speakers, and 12 of male speakers; see ITU-T, 

15 (1 996), "Recommendation P. 830, Subjective Performance Assessment of 
Telephone Band and Wideband Digital Codecs", Annex D, ITU, Geneva. 
Twelve listeners participated In the test. The test results, listed in Table 2 
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and Table 3, indicate tliat tlie subjective quality of the 2.8 l^bps EWI 
exceeds thiat of G. 723.1 at 5.3 l<bps, and it is sliglitly better than that of 
G. 723.1 at 6.3 l<bps. The EWI preference is higher for male than for 
female speal<ers. 



Test 


2.8 kbps 
Wl 


5.3 kbps 
G.723.1 


No 

Preference 


Female 


40.28% 1 33.33% 


26.39% 


Male 


48.61% 24.31% 


27.08% 


Total 


44.44% 


28.82% 


26.74% 



Table 2 

Table 2 shows the results of subjective A/B test for comparison between 
the 2.8 kbps EWI coder to 5.3 kbps G.723.1 . With 95% certainty the result 
lies within +/-5.53%. 



Test 


2.8 kbps 
Wl 


6.3 kbps 
G.723.1 


No 

Preference 


Female 


38.19% 1 36.81% 


25.00% 


Male 


43.06% 31.94% 


25.00% 


Total 


40.63% 1 34.38% 


25.00% 



Table 3 



25010134.1 



27 



Table 3 shows the results of subjective A/B test for comparison between 
the 2.8 kbps EWI coder to 6.3 kbps G.723.1 . With 95% certainty the result 
lies within +/-5.59%. 

It should, of course, be noted that while the present invention has been 
5 described in terms of an illustrative embodiment, other arrangements will 
be apparent to those of ordinary skills in the art. For example; 

1 . While in the disclosed embodiment in FIGURE 3 have described 
auto-regressive (AR) synthesis filter, in other arrangements moving- 
average (MA) filter may be used. 
10 2. While in the disclosed embodiment was related to waveform 

interpolative speech coding, in other arrangements it may be used in other 
coding schemes. 

3. While in the disclosed embodiment temporal weighting, and/or 
spectral weighting are described, they are optional, and in other 

15 arrangements any or both of them may not be used. 

4. While in the disclosed embodiment switch prediction having two 
predictors is described, in other arrangements no switch, or more than two 
predictor choice may be used. 

5. While in the disclosed embodiment illustrated in Figure 6 mean 
20 vectors are subtracted from the vector, this may be viewed as optional, 

and in other arrangements any or all of such mean vectors may not be 
used. 

6. While in the disclosed embodiment the pitch range and/or the 
voicing parameter values were partitioned into subranges, and codebooks 
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were used for each subrange, this may be viewed as optional, and in other 
arrangements any or all of such subranges may not be used, or other 
number or type of subranges may be used. 

7. While in the disclosed embodiment describes prediction matrices 
5 were diagonal, in other arrangements non diagonal prediction matrices 
may be used. 
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IEEE ICASSP'95, pp. 508-511, 1995; W. B. Kleijn, and J. Haagen, 
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